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Message and state cooperation in multiple 

access channels 

Haim Permuter, Shlomo (Shitz) Shamai, and Anelia Somekh-Baruch 

Abstract 

We investigate tiie capacity of a multiple access channel with cooperating encoders where partial state information 
is known to each encoder and full state information is known to the decoder. The cooperation between the encoders 
has a two-fold purpose: to generate empirical state coordination between the encoders, and to share information about 
the private messages that each encoder has. For two-way cooperation, this two-fold purpose is achieved by double- 
binning, where the first layer of biiming is used to generate the state coordination similarly to the two-way source 
coding, and the second layer of binning is used to transmit information about the private messages. The complete 
result provides the framework and perspective for addressing a complex level of cooperation that mixes states and 
messages in an optimal way. 

Index Terms 

Channel state information, cooperating encoders, coordination, double-binning, message-state cooperation, mul- 
tiple access channel, superbin. 

I. Introduction 

State-dependent channels describe a rich variety of communication models spanning the cases, where the states 
are governed by physical phenomena (such as fading), and accounting also for situations where the states model 
effects of interfering transmissions. Their wide applicability, theoretical importance, and practical implications, led 
to intensive information theoretic studies. We focus here on a multiple-access channel (MAC), where the channel is 
affected by the state (5*1, ^2) known partly at the transmitters. That is, state Si is available at Transmitter 1, while 
S2 is known at Transmitter 2. This can be associated with local cognition, that is. Transmitter 1 learns before hand 
about the sequence Si, while Transmitter 2 learns about ^2. We further assume that the states, which can be viewed 
as channel-affecting parameters, are known at the receiving point, or alternatively are retrieved accurately by the 
receiver. This is a standard problem, which falls within the class of decentralized processing at the transmitters. 
The focus of this work is the implications of transmitter cooperation facilitated by an orthogonal finite capacity 
link. This fink can be used both to share state information, as to facilitate a more coordinated operation, up to a 
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Fig. 1. MAC with cooperation where different partial state information is known to each encoder, and full state information is known to the 
decoder. 



degree of central coordination, achieved when both transmitters know accurately (5i, 52). The cooperation link can 
also be employed to share messages, to the extreme of full message cooperation, turning the problem into a single 
two-elements (antennas) transmitter. The interplay among these types of cooperation is at the center of our paper, 
and here the optimal approach, given in terms of the associated capacity region, is found. Evidently the derivation 
of this general result is extending previous important cases as it is detailed in the following. 

Willems H], ||2| introduced and derived the capacity region of the multiple access channel (MAC) with cooperating 
encoders. He showed that to achieve the capacity region the encoders should use the cooperation link in order to 
share parts of their private messages and then use a coding scheme for the ordinary MAC, which was found earlier 
by Slepian and Wolf (|3]. 

In this paper, we consider the problem of MAC with cooperating encoder, where different partial state information 
is known at each encoder and perfect state information is known at the decoder The setting of the problem is depicted 
in Fig. [U The state of the channel is given by the pair (5i, 52), where Encoder 1 knows 5i, Encoder 2 knows 52, 
and the decoder knows the pair (5i, 52). The cooperation links C12 and C21 may increase the capacity region by 
transmission of the state information that is missing to the encoders and by sharing parts of the private messages 
(toi, 7712). Here the transmission of the state information is done by achieving an empirical coordination H of the 
state information, namely, generating sequences of action that are functions of the cooperation and are jointly typical 
with the state information. Simultaneously, these sequences of action are designed in such a way that they allow 
the encoders to share parts of their private messages. To achieve this purpose we use double-binning, a technique 
that was used by Liu et. al ||5], ||6| for achieving secrecy capacity in the broadcast channel. 

The problem of cooperating encoders with partial state information combines two kinds of settings that are widely 
treated in the literature; the first is limited-rate noise-free cooperation between users and the second is limited-rate 
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noise-free state information that is available to encoders/decoders. 

Cooperation between users through a noise-free limited-rate link has been investigated in various of multi-user 
settings such as in MAC H], 121, Q, lUl, interference channel ll9l- lfT5l . broadcast channel lfT6l . relay channels 
lfT7l - |fT9l . and cellular networks ll20l . A comprehensive survey of cooperation and its role in communication is given 
in ETI . Recently, cooperation between encoders where state information is available was considered in ll22l . Il23l 
where it is assumed that the cooperation is allowed only before the state information is available at the encoders. In 
this paper, we take a different approach, assuming that the cooperation occurs after the state information becomes 
available, the cooperation may include parts of the private message and the state information as well. 

The second setting, that is, limited-rate state information at encoders/decoders, was first treated by Heegard and 
El-Gamal ||24|| . The case, most related to the setting in this paper, where full state information is available at the 
decoder and limited-rate state information is known at the encoder was solved by Cemal and Steinberg for the 
point-to-point channel ||251 and for the MAC ll26l . The main difference between the setting here and the setting 
in ll26l is that here the limited-rate encoder knows the state and the private message rather than just the private 
message; therefore, a scheme which combines message information and state information is needed. 

The remainder of the paper is organized as follows. In Section HIl we derive the capacity region where only 
one cooperation link from Encoder 1 to Encoder 2 exists. This setting helps us to gain the intuition necessary for 
solving the extended problem of two-way cooperation, which is solved in Section |III] In Section IIVI we solve a 
specific example and compare the capacity region to two different cooperation settings given in |22!] and in ll26l . In 
addition, in Section [TVl we check the strategy of splitting the cooperation link into message-only link and state-only 
link, and we show that this naive strategy is strictly suboptimal. 

II. One-way cooperation 

In this section, we consider a special case, in which there is only one-way cooperation from Encoder 1 to 
Encoder 2. In addition, we assume that Encoder 1 and the decoder have full non-causal state information. This 
setting captures the idea of, simultaneously, sharing a part of the private message mi and sharing the information 
on channel state 5*. The setting is depicted in Fig. |2] We start by defining the notation and the code for this setting, 
then we state the capacity region, explain the intuition and provide its proof. 

The MAC setting consists of two transmitters (encoders) and one receiver (decoder). Each sender I € {1,2} 
chooses an index mi uniformly from the set {!,..., 2"^'} and independently of the other sender. The input to the 
channel from encoder / e {1, 2} is denoted by {Xi i, Xi^2, Xi ^, ...}, and the output of the channel is denoted by 
{Yi, 12,^3, •■•}■ The state at time i, i.e.. Si G S, takes values in a finite set of possible states iS. The channel is 
characterized by a conditional probability P{yi\xi,i,X2,i,Si) and by the state probability P{si). Both probabiUties 
do not depend on the time index i and satisfy 

P{yi, St+i\x\, xl, s\y'^^) = P{yi\xi.i,X2,t,Si)P{si), (1) 

where the superscripts denote sequences in the following way: x] = {xi,i,xi,2, xi,i), I G {1, 2}. 
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Fig. 2. MAC with one-way conferencing and state information at one encoder and tlie decoder 



Definition 1: A (2"^^ , 2"^^ , 2"*^" , n) code with one-way cooperating encoder as shown in Fig. |2] consists of 
three encoding functions 

/i : {1,...,2"^'} xS" ^ X^, 
/i2 : {1,...,2"^i}x5"k^{1,...,2"^-}, 

/2 : {l,...,2"«nx{l,...,2"^-}^->A'2", (2) 

and a decoding function, 

: 3^" X 5" {l,...,2"^i} X {1,...,2"^^}. (3) 

The average probability of error for (2"^^ , 2"^^ , 2""-^^^, n) code is defined as 

i^i"^ = 2"(i+fl2) E Pr{5(^",^")7^(mi,m2)|(mi,m2)sent}. (4) 

A rate (i?i,i?2) is said to be achievable for the one-way cooperating MAC with cooperation link C12, if there 
exists a sequence of (2"^^ , 2"^^ , 2"*-^^^ , n) codes with Pi"-* 0. The capacity region of MAC is the closure of 
all achievable rates. The following theorem describes the capacity region of one-way cooperating MAC. 

Theorem 1: The capacity region of the MAC with a cooperating encoder that has state information as shown in 



Fig. |2]is the closure of the set that contains all rates that satisfy 

C12 > I{U;S) (5) 

Ri < IiXuY\X2,S,U) + Ci2~HU;S) (6) 

i?2 < IiX2;Y\Xi,S,U) (7) 



I{Xi,X2;Y\S, U) + Ci2-nU;S), 
I{XuX2;Y\S) 



R1 + R2 < 
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for some joint distribution of the form 

P{s)P{u,xi\s)P{x2\u)P{y\xuX2,s). (9) 

Lemma 2: 1) The capacity region described in Theorem [T] given in (l5]l-(|9|l, is convex. 

2) It is enough to restrict the alphabet of the auxiliary random variable U in Theorem [T] to satisfy 

\U\ <min(|A:'i||A'2||5|+3, |3^||5|+4). (10) 

Before proving the theorem and the lemma let us investigate the role of the auxiliary random variable U in 
Theorem [T] The random variable U plays a double role: first, it generates an empirical coordination between the 
two encoders regarding the state of the channel; second, it generates a common message between the two encoders. 
Let us look at two special cases which emphasize these two roles. 

Case 1: The point-to-point case / |25]/ . i.e., Ri = and P{y\xi,X2, s) = P{y\x2,s). For this case the rate region 
of Theorem [T] becomes 

Ci2 > IiU;S) (11) 
i?2 < I{X2;Y\S,U) (12) 

, j I{X2;Y\S,U)+C^2~I{U;S)\ 
R2 < mm < > , (13) 

I i{X2;Y\s) J 

which is simply 

C12 > IiU;S) (14) 
R2 < I{X2;Y\S,U) (15) 

(16) 

for a joint distribution of the form P{s)P{u\s)P{x2\u)P{y\x2, s). 

Case 2: \S\ = 1, the memoryless case In this case I{U ; S) =0, hence we obtain a special case of MAC 
with cooperation and the rate region of Theorem [T] becomes 

Ri < I{Xr,Y\X2,U)+Ci2 (17) 

R2 < I{X2;Y\Xi,U) (18) 

f I{Xi,X2:Y\U) + Ci2 1 
R1+R2 < rami ' } , (19) 

[ I{Xj,X2;Y) J 
for a joint distribution of the form P{u)P{xi\u)P{x2\u)P{y\x2, xi). 

Note that in the first case the role of the auxiliary random variable U is to generate an empirical coordination 
P[/|5, and then use the sequence [/" as common side information at the encoder and decoder In the second case, 
the auxiliary random variable represents the common message mo between the two encoders, and the decoder 
needs to decode it. In Theorem [T] these two roles are combined. Namely, the sequence U" needs to be coordinated 
with 5" and simultaneously represents a common message. Fig. [3] illustrates the role of cooperation. On one hand. 
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the cooperation needs to generate a sequence U" that is jointly typical with S*", i.e., lim,i^oc Pi'{(C/", 5") G 
Te"\u, S)} = 1, and on the other hand, there should be a function g(U^^) such that one can estimate the message 
M with high probabiHty, i.e., lim„^oc. Pr{.9(C/") ^ M} = 0. If i? > i?™ + I{U;S) and i7([/|S') > i?,„, this 
goal can be achieved. Combining these two roles (generating empirical coordination and transmitting a message) 
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Fig. 3. A problem that illustrates the double role of cooperation. One one hand, the sequence needs to be jointly typical with 5", and on 
the other hand, one should be able to reconstruct the message m with high probability. 



is done by binning, where the bin number represents the common message and in each bin there will be enough 
codewords [/" such that at least one codeword is jointly typical with S"". This is similar to the role of the auxiUary 
random variable in Gelfand-Pinsker lIZTl . where the sequence of the auxiliary random variables that is generated 
needs to represent a message that is transmitted via the channel and needs to be jointly typical with the sequence 
of the channel states. 

Next we present a formal proof of Theorem 1. Throughout the achievability proofs in the paper we use the 
definition of a strong typical set. The set T^"\x,Y, Z) of e-typical n— sequences is defined by {(a;",y",z") : 
iA^(a;, 2/, zja;", y", z") —p{x,y,z)\ < ep{x,y, z)\/{x,y, z) e X x y x Z}, where A^(.t, y, z|x", y", z") is the 
number of appearances of {x,y,z) in the ti— sequnce (x", y", z"). Furthermore, we will use the following well- 
known lemma 1281 - 1311 . 

Lemma 3 (Joint typicality lemma): Consider a joint distribution Px,y,z and suppose (a;", y") G Tt^^\x, Y). Let 
Z" be distributed according to 11"= i Pz\x{zi\xi). Then, 

Pr{(x",y",Z") G T^'^\X,Y,Z)} < 2-"(^C*';2|^)-'5W)^ (20) 

where limj^o S{e) = 0. 
Proof of Theorem Q} Achievability part. 

Code construction: Generate 2""-^^^ codewords [/" independently using i.i.d. ~ P{u), and assign them into 
2n(Ci2-/(c/;S)-e) i^jjjg Hence, in each bin there are 2"(^^'^'"^^"'"'^^ codewords. For each codeword where 
i = l,2,...,2"'^i2 and for each s" G 5" generate 2"(^i'(C'i2-/(c/;S)-£)) codewords XJ* according to i.i.d. - 
P{xi\u,s) and for each u"-{j), where j = 1, 2, 2""^i2, generate 2"(^2~('^i2~-^('^''^))) codewords according 
to i.i.d. ^ P{x2\u). 

Encoder: Split message mi G [1, 2"-'^i] into two messages mi_a G [1, 2"'^'^i2~^*^'^''^)~'^^] and mi_h G 
[1, ...,2"(^i"('^i2"^(^'-^)"^))]. Now, associate each message mi^a e [1, 2"('^i2'-f(^''^)-')] with a bin, where 
in each bin there are 2"'^-^'^'^''^)''''' codewords w", indexed by I G [1, 2"^^^'^''^'"*''^)]. Find in the chosen bin a 
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codeword, denoted by u"(mi a, s"), with the smallest lexicographical order that is jointly typical with s" and send 
its index [1, to Encoder 2. If such a codeword does not exist, namely, among the codewords in the bin 
none is jointly typical with s", choose an arbitrary it" from the bin (in such a case the decoder will declare an 
error). Now, Encoder 1 transmits .t"(s", w"(mi^a7 s"), JTii^b), and Encoder 2 transmits X2 (w"('Tii^a, s"), '71,2). 

Decoder: The decoder knows s" and y" and looks for the indices mi^a G [1, 2"('^i2~^'^'^''^^~'^^], mi j, e 
[l,...,2"('"i-(^i2-/(c/;S)-<;))]^ ^2 g [l,...,2"-"'2] such that 

K(ml,„,s"),z^(s^^i"(^7M,a,s"),ml,6),x^K(TOl,,,s"),TO2),s",y"^ (21) 

If none or more than one such triplet is found, an error is declared. The estimated message sent from Encoder 1 
is (TOi.a,™i.b), and the estimated message transmitted from Encoder 2 is 7712. 
Error analysis: Assume (mi a, "ii.bj ™2) = (Ij 1, !)• Let us define the event 

E^,,,k = {K(*,s"),x?(s",«"(*,s"),j),^2(«"(^s"),j),s",y") e ri")((7,Xi,X2,5,r)} . (22) 

An error occurs if either the correct codewords are not jointly typical with the received sequences, i.e., ^ ^, or 
there exists a different k) ^ (1, 1, 1) such that Eij,k occurs. From the union of bounds we obtain that 

i=l.j = l.fc>l i=l,j>l.k=l i=l.j>l,k>l i>l,j>l.k>l 

(23) 

Now let us show that each term in ( |23] | goes to zero as the blocklength of the code n goes to infinity. 

• Upper-bounding Pt{Ei ^ i): Since the number of codewords in each bin is larger than 2"^''^''^\ and since the 
codewords were generated i.i.d., with high probability there will be at least one codeword that is jointly typical 
with s". We denote this sequence as it"(l). Furthermore, given that s") e ri")([/, S), it follows from 
the law of large numbers that Pr{Ef ^ i) — > as n goes to infinity. 

• Upper-bounding X]i=i j=i A:>i P^(^«.i fc)' The probability that F", which is generated according to 
P{y\xi, s,u), is jointly typical with which was generated according to P{x2\u) — P{x2\u, s, xi), where 
(a;^ s", w") e ri")(Xi, S, U) is bounded by (Lemma EJ 

Pr{«,X^\w",s",y") G ri")|(a;l\w",s") e T^")} < 2-"(-f(-^2;^l^i.-5^^)-'5(<^)). ^24) 
Hence, we obtain 

E Pr(^^^-.fe) < 2"«^2-"(^(^^'^l^i'^^^)-'5(^)) (25) 

• Upper-bounding X]j=i j>i fe=i P^(^« j *^)" probability that Y" which is generated according to 

P{y\x2T s,u) is jointly typical with .t" which was generated according to P{xi\u,s) = P{xi\u, s,X2), where 
G ri")(X2,S', C/) is upper bounded by 2-"(-f(^i'^l-^2,sxo-'5(^)), hence 

^ Pr(i;,jfc) < 2"(^i"('^i2--^(^''^)-'))2-"(^('^^''*'l^i'^'^)~''('^)). (26) 
1=1 j>i,fc=i 
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Upper-bounding E,=ij>i,fe>i Pr(-E,:j,fc) 

i=l J>l,fc>l 

Upper-bounding X]i>ij>i.fe>i 



i>l j>l,fc>l 

^ 2"(-"i+^2--f(-^2,Xi,C/;y|S)-<5(e)) ^2S) 

Therefore, combining the upper bounds (|25Tl-(|28]l into ( |23] l. we obtain that if rate-pair R2) is inside the rate 
region given by (|5]l-(|9]l, then there exists a sequence of codes (2"^% 2"^^ 2"'^i2 sqqJj ^jjat Pi"' goes to zero 
as 71 —> 00. 

Converse part: Assume that we have a (2"^^ , 2"^^ , 2"*-^!^ , n) code as in Definition[T] We will show the existence 
of a joint distribution P{s)P{u\s)P{xi\s, u)P{x2\u)P{y\xi, X2) that satisfies (I5]l-(l8]l within some e„, where e„ goes 
to zero as 77, — !> 00. Denote il/12 = /i 2(^/1, 5"). Then, 

nCi2 > i/(A/i2) 

> /(Afi2;5") 

71 

Y,I{S,-U.{), (29) 

i=i 

where (a) follows from the fact that 5^ is i.i.d. and (b) follows from the definition of Ui, which is 

[/, ^(Afi2,5*-i). (30) 

Next, consider 

nRi = H{Mi) 

= H{Ah\S''',M2) 

= ff(A/i,A/i2|^",A/2) 

= H{Mi2\S'\ A/2) + H{Ah\S'\ M2, M12) 

< i/(A/i2|5")+i/(A/i|5",A/2,A/i2). (31) 
Now, let us consider the terms H{Mi2\S"-) and i7(A/i jS*", A/2, Afi^2) separately. 

/f(A/i2|5") = /r(A/i2|5")-/r(A/i2) + /r(A/i2) 

< nCi2-I{S";Mi2) 

n 

= nCi2-^/(5,;t/,), (32) 

4=1 



where the last equahty follows from ( |95] l where it is shown that /(A/12; 5*") = J27=i -^i^i' ^i)- Further, 

/f(A/i|5",A/2,Mi2) 

/(Mi;y"|5",A/2,A/i2)+ne„ 
= /r(y"|5", A/2, A/12) - H{Y''\S'\ A/2, A/12, Ml) + ne„ 

//(y"|5", X2", A/2, A/12) - H{Y"\S^, XJ,\X^, A/2, A/12, A/i) + nen 

n 

= H{Y,\V\ S^,X1^, A/2, A/12) - A/2, A/12, A/i, r'-i) + ne„ 

1=1 

(c) " 

< H{Y,\S,, X2,., M12, S'~^) - H{Y,\S,,X2,r,Xi,„ A/12, 5'-i) + ne„, (33) 

i=l 

where (a) follows from Fano's inequality and from the definition = /?iPi"\ (b) follows from the fact that X" 
is a deterministic function of (S'",A/i) and X2 is a deterministic function of (A/2, A/12), and (c) from the fact 
that conditioning reduces entropy and from the Markov chain Yi — (Si, X2^i, Xi^i) — (5", X2, X^, A/2, A/12, Mi). 
Substituting Inequalities ( [32] ) and ( [33] ) into ( [99] l, we obtain 

n 

n/?i < ^/(r,;Xi,,|5„X2,„C/,)-/(5.;C/») + nCi2. (34) 

Similarly, we have 

nR2 = HiA'h) 

= /f(A/2|5",A^i,A/i2) 

n 

< ^/(K,;X2,,|5„Xi,„C/0, (35) 

i=l 

where the last inequality follows from similar steps as in ( [33] ). Regarding the sum-rate we have 

n/?i+n/?2 = //(A/i,A/2) 

= /r(A/i,M2|5") 

= /(A/i,A/2;r"|5") + ne„ 

= J2 HiY^lY'-^S-^) - /r(r,| A/i, A/2, 5", Xi", X2") + ne„ 

n 

< Y H{y.\S^) - H{Y,\S,,Xl^,,X2,^) + nen 

i=l 
n 

< ^/(Xi,„X2,,;F,|5,)+ne„ (36) 

and 



nRi + 7i/?2 



= /r(A/i,A/2) 

= //(A/i,A/2,A/i2|^") 
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= i7(Mi2|5") + H(Afi,Af2|A/i2,5")+nen, (37) 
and now using ( |32] | and similar steps as in ( |33] | we obtain 

n 

nRi+nR2 < ^ /(F,; X2^,|5„ [/,) - /(S,; t/,) + nCi2. (38) 
1=1 

Now we verify that the Markov chain X2,i ~ Ui — {Xi^i,Si) holds (this is due to the Markov chain 
A/2 - (A/i2, S'-'^) - (A/i, 5")). Finally, let Q be a random variable independent of (X", 5", F"), and uniformly 
distributed over the set {1, 2, 3, .., n}. Define the random variables U = {Q,Uq). Using the simple observation 
that I{Xi,X2;Y\S,Q) < I{Xi, X2;Y\S), we obtain that the region given in (ISll-® is an outer bound to any 
achievable rate. ■ 

Proof of Lemma |2} First we prove that the capacity region described in Theorem [T] (IS])-©, is convex and 
therefore there is no need to convexify it. Let P^, z = 1, 2, 3 be three distributions of the form 

P{s)P{u,xi\s)P{x2\u)P{y\xi,X2,s), (39) 

which induce the quantities 

5), y|X2, 5, (7), /,(X2; Y\X^,S, U),I,iX,,X2;Y\S, U), X2; Y\S)), (40) 

for i = 1,2,3, respectively. In addition, let P3 = aPi + aP2, where < a < 1 and a = 1 — a, furthermore when 
q = I the distribution of U,Xi,X2 is according to Pi and when g = 2 it is according to P2. Let Q be a binary 
random variable with P{q = 1) = a and P{q = 2) = 1 — a. Let us denote U — {U, Q), and note that P3 is of 
the form of (|39] l where U replaces U. Finally, the convexity of the region in (|5]l-(|9]l follows from the equalities 
aIi{U ; S) + al2{U ; S) = IsiU; S), and similar equalities for the other terms in (|40] |. and from the inequality 

ah{Xi,X2;Y\S) + ahiXi,X2;Y\S) = h{Xi,X2;Y\S,Q) 

< hiXi,X2;Y\S). (41) 

Now, to prove the cardinality bound on U, we invoke the support lemma |[28l p. 310]. The auxiliary 
random variable U needs to have |A'i||A2||iS| — 1 letters to preserve p{xi,X2,s) plus four more to preserve 
the expressions H{S\U), I{Xi;Y\X2, S,U), l,{X2;Y\Xi, S,U), and I{Xi, X2;Y\S,U). Note that the joint 
distribution p{xi,X2, s, y) is preserved because of the Markov form U— {Xi,X2, S) — Y. Alternatively, the external 
random variable U needs to have |3^||tS| — 1 letters to preserve P{y,s) plus five more to preserve the expressions 
HiS\U), IiXi;Y\X2,S,U), I,{X2;Y\Xi, S,U), /(Xi, X2; (7), and H{Y\Xi,X2,S,U). ■ 

III. Two-way cooperation 

Here we extend the setting from the previous section to a MAC with two-way cooperation where different state 
information is available at each encoder and full state information is available at the receiver, as depicted in Fig. [T| 

Definition 2: A (2"^^ , 2"^^ , 2"*-^" , 2"*-^^! , n) code with two-way cooperating encoders, where each encoder has 
partial state information, consists of four encoding functions 

/12 : {l,...,2"«i}x5i"^{l,...,2"^-}, 
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/21 : {l,...,2"«nx{l,...,2"^-}x52"^{l,...,2"^-}, 
/i : {l,...,2"-^i} X {l,..,2"'^^i} X ^"1", 

/2 : {l,...,2"-^i} X {l,...,2"'^i^} X 5^ h-> ^"2": (42) 

and a decoding function, 

g-.y" xS^ X ^ {l,...,2"^i} X {1,...,2"-^^}. (43) 

The probability of error, achievable rates, and the capacity region are defined similarly to Definition [T] The next 
theorem states the capacity region of the two-way cooperating encoders with partial state information. 

Theorem 4: The capacity region of the MAC with two-way cooperating encoders and with partial state 
information as shown in Fig. [T] is the closure of the set of rates that satisfy 



C\2 


> 


I{U;Si\S2) 




(44) 


C2I 


> 


I{V;S2\SuU) 




(45) 


Ri 


< 


I{Xi;Y\X2,Si,S2,U,V)^ 


-Ci2~I{U;Si\S2) 


(46) 


R2 


< 


/(X2;y|Xi,5i,52,f/,F)4 


'C2i~I{V;S2\Si,U) 


(47) 
(48) 


-R2 


< 


. [ I{Xi,X2;Y\X,,Si., 
mm < 


,S2,U,V) + Ci2 + C21 - I(U; Si\S2) - I{V; S2\Si, U) 
I{Xi,X2] Y\Si,S2) 


1 , (49) 



for some joint distribution of the form 

P(si, S2)P{u\si)P{v\s2,u)P{xi\si,u, v)P{x2\s2,u, v)P{y\xi, X2, Si, S2), (50) 

where U and V are auxiliary random variables with bounded cardinality. 

In the achievabiUty proof of the theorem we use double-binning, which was introduced by Liu et al. ||5], S to 
achieve secrecy capacity in the broadcast channel. Here the double-binning is needed since one layer of binning will 
be used for transmitting a common message between the encoders and an additional layer of binning is needed for 
choosing a specific typical sequence using side information as done in the Wyner-Ziv problem 1321 and two-way 
source coding ||33l . In a double-binning coding scheme we have special bins that contain other bins rather than 
codewords, and we call such a special bin a superbin, as depicted in Fig. |4] 
Proof: 

AchievabiUty part: 

Code construction: We generate 2"'^'-^i=^~^'^'^''^i^+^'^'^'^2^~^'^) superbins, where each superbin contains 
2n(/(c/;Si)-/(c/;S2)+2e) ^^^^^ g^^jj contains 2"(^(^''S2)-0 codewords f/", generated i.i.d. - P{u). Hence, 
there are 2"(^('^^'^i)+'^' codewords in each superbin and there are in total 2""-^^^ different bins. The index sent from 
Encoder 1 to Encoder 2 will be a bin number, and the superbin that contains the bin will represent a common 
message that is sent from Encoder 1 to Encoder 2. 
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a bin 

(contains codewords) 




a codeword 



a superbin 
(contains bins) 



2n{/(r7;S2)-e) 




2n(/([/;S2)-£) 



Fig. 4. Double-binning for the acliievability of Tlieorem |4] Double-binning (3) consists of two-layer bins, where in the first layer we have 
bins that contain codewords and in the second layer we have superbins that contain bins. 



For each codeword w", we generate 2"''-^2i /(y;S2|(7)+/(i/;Si|(7) 2c) gy^erbins, where each superbin contains 
2nii(V;S2\u)-iiV;Si\u)+2e) ^jjj^^ g^^j^ ^jjj contains 2"(-f(^'^il^)-^) codewords F", generated i.i.d. - P{v\u). 
Hence, there are 2"^^^^^'^^)+'^' codewords in each superbin and there are total of 2"*-^^^ different bins. 

For each pair of codewords (u", u") and for each sequence s" generate 2"(^i~('-^i2~^('^''^i)+^(^''^2)~^'^)^ 
codewords of X" i.i.d. ^ P{xi\si,u, v). Similarly, For each pair of codewords (it", w") and for each sequence S2 
generate 2"(^2-(C'2i--f(V';S2|c/)+/(i/;Si|c/)-2e))) codewords of i.i.d. - P{x2\s2,u,v). 

Encoder: SpUt message mi S [l,...,2"^i] into two messages mi,a G [x, 2"('^i2"^(^''^i)+^(^''^2)~2^'] and 
mib G [1, ...,2"(^i-('='i2"-f(^'^i)+-f(^'^2)-2e))]_ 

Associate each message mi a with a superbin, where in each superbin there are total of 2"(^('^;'Si)+'=) codewords 
w". Search the chosen superbin for a codeword, denoted by ^"(TOi.a, s"), with the smallest lexicographical order 
that is jointly typical with s" and send its bin number [1, 2^'^^] to Encoder 2. If such a codeword [/" does not 
exist, namely, among the codewords in the bin none is jointly typical with s", choose an arbitrary u" from the bin 
(in such a case the decoder will declare an error). Now, Encoder 2 receives a bin number that contains 2"^^^'^^'^2)~^^ 
possible It" codewords, and looks for the codeword with smallest lexicographical order that is jointly typical with 
82 - If such a codeword [/" does not exist, namely, among the codewords in the bin none is jointly typical with Sj, 
choose an arbitrary m" from the bin (in such a case an error will be declared). 

Now, split message 777.2 & [1, 2"-^^] jjuo messages TO2,a e [1^ ...^ 2"('^i2-^(^''^2|c/)-H/(V;Si|(7)-2e)] ^^^^ 

TO2 b e [1, 2"(^2-(C2i-/(V;S2|C/)+/(y;Si|C/)-2e))j^ 

Associate each message m2,a with a superbin, where in each superbin there are in total 2"(^(^'^2l'^)+'=) codewords 
w". Find in the chosen superbin a codeword, denoted by u"(m2,a, s^, w"), with the smallest lexicographical order 
that is jointly typical with (sj , and send its bin number [1, 2^^'^] to Encoder 1. If such a codeword w" does 
not exist, namely, among the codewords in the bin none is jointly typical with {s2,u"), choose an arbitrary v" 
from the bin (in such a case the decoder will declare an error). Now, Encoder 1 receives a bin number that contains 
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2n{i{v-Si\u)-e) possible codewords, and looks for the codeword with the smallest lexicographical order that is 
jointly typical with (s", w"(mi.a, s")). If such a codeword T^" does not exist, namely, among the codewords in the 
bin none is jointly typical with (s", u"(mi_o, s")), choose an arbitrary w" from the bin (in such a case an error 
will be declared). 

Now, Encoder 1 transmits a;"(s", u", w", mi^b), and Encoder 2 transmits 1 ^"j ™2,())- 

Decoder: The decoder knows (s",S2,2/") and looks for the indices mi. a, toi.!,, m2,a and 7712,6 such that 

(W"(777l.a, S^^), 7;"(7f72,a, , u") , {s'^ , u" , v" , mi,b),X^{s^, u" , , 7772,^) , s" , S^, 2/") & ri") {U, V, X^, X2, 81,82, Y) . 

(51) 

If none or more than one such quadruplet is found, an error is declared. The estimated message sent from Encoder 
1 is (7TI1 7771J,), and the estimated message transmitted from Encoder 2 is (7772.a, nT-2,6)- 
Error analysis: Assume (77ti_a, 7772.0, ^ifi, fn2,b) = (1, 1, 1, !)■ Let us define the event 

(52) 

We have an error if either the correct codewords are not jointly typical with the received sequences, i.e., E^-^i-^, 
or there exists a different k, I) ^ (1, 1, 1, 1) such that Eij,k.i occurs. From the union of bounds we obtain that 

i=l,i=l,A:=l,i>l j = l,A;>l,i=l i=l j = l,fc>l,i>l 

+ Y Pr(£;,,,-fc,0- (53) 

{i,j)^l,k>l,l>l 

Now let us show that each term in i53[ goes to zero as the blocklength of the code 77 goes to infinity. 

• Upper-bounding PT{Ef i i i): Since the total number of codewords in each supperbin associated with i (or 
77ii_o) is larger than I{U;8i), and since the codewords were generated i.i.d. ^ P{u), with high probability 
there will be at least one codeword that is jointly typical with s". Let us denote this codeword by 7i" (l, s"). 
Since the Markov form U — 81 — 82 holds, from the Markov lemma 1341 with high probabiUty ?7"(l,s") 
would be jointly typical with ^2 . Furthermore, since each bin in the superbin that is associated with i contains 
2n(7(c/;S2)-e) codcwords, with high probability, there will not be any additional codeword that is jointly typical 
with S2, hence. Encoder 2 would identify u"'{l, s") from the received bin. 

Similarly, for a given G Ti"''(C/|s", S2), which is known to Encoder 2, the total number of codewords in 
each supperbin associated with j (or 7772.0) is larger than I{V; 82\U), and since the codewords were generated 
i.i.d. according to P{v\u), with high probability there will be at least one codeword that is jointly typical with 
(s2,?i"). Let us denote this codeword by 7;"(1, , li") . Since the Markov form V — {82, U) — 81 holds, it 
follows from the Markov lemma that with high probability 7;"(1, S2 , would be jointly typical with (s", m"). 
Furthermore, since each bin in the superbin that is associated with j contains 2"^^^^''^il'^)^'^) codewords, with 
high probability, there would not be any additional codeword that is jointly typical with (s",7i"), hence. 
Encoder 2, would identify , w") from the bin. 
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Furthermore, given that (u",u", 55^,5^) e T^"'\U,V, 81,82), it follows from the law of large numbers that 
Pr(i?J ]^ ]^) — > as n goes to infinity. 

Upper-bounding j=i k=i i>i^'^i-^i,j-k.i)' The probability that F", which is generated according 

to P{y\xi, s,u,v), is jointly typical with Xj, which was generated according to P{x2\u,v,S2) = 
P{x2\u,v,S2,si,xi), where (x", s", : w") £ T^"\Xi, 81, 82,U,V) is upper bounded according to 
Lemma |3] by 

Pt{{x'^,XS,u",v",s'1,s^,Y") e Ti")|(a;^u",w",s5',s^) e T]")} < 2-"(^(^2''*'l^i'^i'«='^'^)-'5(<^)). (54) 
Hence, we obtain 

i=i j"=i,fc=i,;>i 

(55) 

Upper-bounding j=i fe>i ;=i f ^'(-^ij-fc ')" The probability that F", which is generated according 

to P{y\x2, s,u,v), is jointly typical with x", which was generated according to P{xi\u,v,si) = 
P{xi\u,v,S2,si,X2), where , s" , , w") £ T^"\X2, 81, 82,U,V) is upper bounded according to 
Lemma |3] by 

Hence, we obtain 

1=1 j"=l,fc>l,/=l 

(57) 

Upper-bounding Ez=ij=i,fc>i,i>i Pr(£^*j.fc.i) 



i=l J = l,fc>l,/>1 

^ 2"(-'^i-('^i2--f('^;-5i)+-f('^;5'2)-2e)+i?,2-(C2i-/(V;S2|;7)+/(y;Si|C/)-26))2-n(/(X2,Xi;F|Si,S2,;7,l/)-5(e)) 

(58) 

. Upper-bounding j=i,fc>i,/>i Pr(^» 



(ij")5^1,fe>lJ>l 

Finally, we note that if the rate-pair R2) is in the rate region that is given by (|44]|-(|50]|, then each term in (l53T l 
goes to zero as n — > 00; hence there exists a sequence of codes (2"^\ 2"-^^, 2"'^i2^ 2"'^2i^ g^-jj jjj^j pi"-) gQgg 
to zero as — > 00. 
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Converse part: The converse part combines techniques from cooperation in a MAC (T\ and two-way source 
coding ll33l . Assume that we have a (2"^i , 2"^^ , 2"'^'^^ , 2"'-^2i , n) code as in Definition|2] We will show the existence 
of a joint distribution P{si, S2)P{u\si)P{v\s2, u)P{xi\si, u, v)P{x2\s2, u, v)P{y\xi, X2, si, S2) that satisfies (|44] |- 
within some e„, where e„ goes to zero as n cxo. Consider 

nCi2 > H{Mi2) 

= H{Ah2\S^) 
> I{M,2;Sl^\S^) 

n 



2^1 

n 



n 

= ''^I{Sl,i; M12, SI 5*2,,;+! 15*2,0 

1=1 

n 

Y,HSl,^■:U,\S2,^), (60) 

i=l 

where (a) follows from the Markov chain Sis — iMi2, S*}"^, S^j, ^+1) — 5*2"^ and (b) follows from the definition 

t/, ^(Mi2,5r\52%i)- (61) 



Now, consider 



nC2i > H{M2i) 

> H{M2i\Ah2,S^) 

> I{M2i;S'^\Mi2,S[') 

n 

= ^ ^{S2,t\S2^i_^i,Si, A/12) - H{S2,t\S2\^^i,Si, M12, M21) 



n. 

(a) 

i=l 
n 

(b) 

i=l 



H{S2,i\S2s+i, S", M12) - H{S2,i\S2\i^i, SI, M12, M21) 

i=l 
n 

Y,H{S2M^Sl,^) - H{S2,^\U^,Sl^,,V,) 

71 

= Y,IiS2,r,V,\U,,Si,,), (62) 

i=l 

where (a) follows from the Markov chain S2.i — {S2 i+i, SI, M12, M21) — S'^j^.j and (b) follows from the definitions 
of Ui given in i6T[ and Vi which is given by 

V.^Ahi. (63) 

Now, consider 

nRi = H{Mi) 
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= H{Mi\S'^,S^,M2) 

= H(M,,M,2\S[\S^,M2) 

= H{Ah2\S-i, Ah) + H{Ah\S-^, SI,\ M2, M12) 

< H{Ah2\S[\ S^) + H{Ah\S'^, S^, M2, M12) (64) 
Now, let us consider the terms H{Mi2\S]', S"^') and H{AIi\S[\ 5?, M2, Mi,2) separately. 

H{Ah2\S[\S^) = H{A4i2\S'^,S^)~H{Ah2) + H(A4i2) 
< nCi2-I{S'^,S^;Ah2) 
nCi2-/(^r;Mi2|^2") 

n 

= «Ci2-^/(5i,.;C/.|52,.), (65) 

where (a) follows from the fact that AI12 is independent of S2, and (b) follows from ( I6OI 1. where it is shown that 
/(S'f ; Mi2|S'J) = ELi ^(-^i,*; C/i|'5'2,i)- Now consider the second term, 

H{Ah\S[\S'2\M2,AIi2) 

= H{A'h\S[\S'2\M2,M,2,Al2i) 

/ (Ml ; y " I , ^2" , ^2 , M12 , M21 ) + ne„ 
= M2, M12, M21) - H{Y"\S^, S^, M2, M12, M21, Ml) + ne„ 

= H{Y''\S[\ S^,X'2\ M2, M12, M21) - ^2 , ^2", M2, M12, M21, Ml) + ne„ 

n 

= HiY,\Y'-\S^, S^, X^, M2, M12, M21) - ^2 , ^2 , M2, M12, M21, Ml, r^-i) + ne„ 

(6) " 

< 2^ H(Yi\Si^i, S2,i, X2^i, M12, S*} , S'2,i+i, -A/21) — H{Yi\Si^i, 82,1, X2^i,Xi^i, M12, 5} , »S'2,i+i, -^^^21) + ne„ 

i=l 
n 

= 5]/(Xi,,;y,|5i,„52,^,^2,z,C/„l/,)+«en, (66) 
1=1 

where (a) follows from Fano's inequality and e„ = RiPe"'^ and (b) from that fact that conditioning reduces entropy. 
Substituting Inequalities ( |65] ) and ( |66] ) into ( |64] |, we obtain 

n 

< ^/(Xi,,;y,|5i,„52,„X2,„t/„-K0-^(5i,.;C/,|52,0 + riCi2. (67) 

Similarly, we obtain 

n 

nR2 < ^/(X2,,;y.|5i,,,52.,Xi,„?7„V,)"^('52.;^.|5i,„f/,) + nC2i. (68) 

i=l 

Regarding the sum-rate we have 

nRi+nR2 = H{AIi,Al2) 

= H{Ah,Al2\S'^,S^) 
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= /(Mi,Af2;r"|5r,^2)+"en 

< /(Xi.„X2,,;r,|5i,„52,.)+ne„, (69) 

and 

nRi+nR2 = H{Mi,M2) 

= H{Mi,M2,Ah2,M2i\S{\S^) 

= H{Mi2\S^, + H{M2i\S[\ S^, M12) + H{Ah,M2\S'^, M12, M21) + e„, (70) 
and now using < [65] t we bound 

n 

H{Mi2\S^,S^) < nC7i2 -^/(5i,,;C/,|52,,), (71) 

i=l 

and similarly 

n 

H{M2i\S^,S^,Mi2) < nC2i-Y.I{S2.,;V,\Si,,,U,). (72) 

1=1 

Using similar steps as in ( |66] | we bound 

n 

H{Mi,M2\S'^,S^\Mi2,M2l) < Y,I{X2,^,Xl,r,Y,\Sl,„S2,^,U^,V,). (73) 

1=1 

Hence we obtain 

n 

nRi +nR2 < ^ /(X2,,, Xi,,; ^2,,, U,, V,) - C/,|52,0 - I{S2,^■, V,\Si,„ U,) + nCi2 + 71C21. 

i=l 

Now we need to verify that the following Markov chains hold: 

(M12, S{-\Sl^^^) - Si,, - 82,,, (74) 

M21 - (^2,.,Ml2,^r\^2,.+ l) - Sl,^, (75) 

Xi,,(Mi, 5^ M21) - Afi2, Sj-i, ^2Vi' ^^21) - S2.,, (76) 

X2,,(M2, M12) - (^2,., M12, M21) - Xi,,(Afi, M21)). (77) 

Proving the Markov chains (I74l)-(l76b is straightforward and therefore omitted. To prove the Markov chain in 
( ITTT i. we use the undirected graphical method from 1351 Section II]. Fig. |5] proves the Markov chain (1/2, 'S'2) — 
(S'2,i, Afi2, Sl~^ , S2 i+i, M21) — {Ml, Si), and as a consequence the Markov chain in ( iTTb holds too. 

Finally, let Q be a random variable independent of (X", S"", S'2 , F"), and uniformly distributed over the set 
{1, 2, 3, .., n}. Define the random variables U = [Q, Uq), V = [Q, Vq), and we obtain that the region given by 
(l44]i-(|50ll is an outer bound to the set of all achievable rate-pairs. 

To show that the cardinaUties of the random variables U and V are bounded we follow similar steps as in Lemma 
121 first for U and then for V. We note that the cardinality of auxiliary random variables U and V may be bounded 
by \U\ < min(|A'i||A'2||5i||52| + 4, |3^||5i||52| + 5), and |V| < nimi\Xi\\X2\\Si\\S2\\U\ + 3, |3^||5i||52||Z^| + 4). 
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Fig. 5. Proof of the Markov chain {M2,SJ) - {82,1, M12, Si~^ , M21) - {A/i,Sf) us- 
ing an undirected graphical technique 1351 . The undirected graph corresponds to the joint distribution 
P{s\~^ , S2^^)P(si^i,S2^i)P{s" S2 ■^-^)P{mi)P(m2)P{mi2\mi, s")P{m2i\rn2,rni2, S2 The Markov chain follows from 
the fact that all the paths from {Mi,S^) to (M2, SJ) go through the nodes (52,i, M12, 5J M21). 



IV. Example and comparison to message-only and state-only cooperation 

Consider the example given in Fig. |6] where the state of the channel controls the switch that determines which 
input goes through a binary symmetric channel (BSC) with parameter p. When 5 = 0, the binary input Xi goes 
through and when S = 1 the binary input X2 goes through, hence the output of the channel Y is given by 



Y = SXi® SX2 ® Z, 



(78) 



where Z ^ Bernouli{^) and is independent of S, the symbol © denotes XOR, and S denotes 1 — S*. We also have 




Encoder2 



BSC(p) 



1-p 



Y 



Decoder 



mi 



7712 



Fig. 6. An example of a MAC with one-way cooperation and state information at one encoder and the decoder The state S controls the 
switch. When S = 0, Y = Xi + Z and when S = 1, Y = X2 + Z , and Z ~ B(p). 



the a constraint on the portion of ' I's at the encoders, namely for any pair of codeword (x", ^2 ), ^ ^i,* ^ Pi 
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and - < P2- Invoking the following identities 

1 



IiXi;Y\X2,S,U) 



^H{X,®Z\S = Q)--H{Z) 



I{X2;Y\Xi,S,U) = ^H{X2(BZ\S=l,U)-^H{Z) 
I{Xi,X2;Y\S,U) = ^H{Xi®Z\S = 0) + ^H{X2®Z\S=l,U)-H{Z) 
I{X,,X2;Y\S) = ^H{X,®Z\S = 0) + ^H{X2(BZ\S^l)-HiZ), 
we obtain from Theorem [T] that the capacity region is the set of all rate-pairs (i?i, R2) that satisfy 



(79) 



-Hb{p.) + Ci2- I{U;S) 



R2 < ^H{X2®Z\S=l,U)-^H,{p,) 
R1+R2 < ^Ht{pi*p.) + ^HiX2(BZ\S = l)-HM 



(80) 



for some conditional distributions P{u\s) and P{x2\u) where I{U;S) < C12. The term Hb{p) denotes the binary 
entropy function, which is defined for < p < 1 as Hi,{p) = —plogp — (1 — p) log(l — p). The term p * q 
denotes the parameter of a Bernoulli distribution that results from convolving mod-2 two Bernoulli distributions 
with parameters p and q, i.e., p* q ^ (1 — p)q + (1 — q)p- 



max/(X2;y|(7, S= 1) — >■ 



\(Ht{Vi*pz)-H,{j,,))-Cr, 




0.1 0.2 0.3 



Fig. 7. Capacity region of the example depicted in Fig. |6] wliere C12 = 0.2, = 0.01, pi = p2 = 0.25. 



Fig. |7] depicts the capacity region for the case where C12 = 0.2, p^ = 0.01 and pi = P2 = 0.25. The capacity 
region was numerically evaluated using dSOl l, where the cardinality of the auxiliary random variable U was assumed 
to be = 2; changing the cardinality to 3, 4, or 5 did not increase the numerical capacity region. 

Fig. |8] illustrates the influence of the cooperation rate on the capacity region. It shows the capacity regions for 
several rates of cooperation C12 = [0, 0.2, 0.5, 1] where p^ — 0.01, Pi = P2 = 0.25. One can see that when the 
cooperation rate is small an increase in the cooperation rate significantly influences the capacity region; however, 
for a large cooperation rate, such as C12 > 0.5, an increase in the cooperation rate hardly influences the capacity 
region. 



20 




Fig. 8. Capacity region of the example depicted in Fig.[6]for several values of C12, i-e, C12 = [0, 0.2, 0.5, 1] and pz = 0.01, pi = P2 = 0.25. 



Comparison to two different kinds of cooperation: In the setting analyzed in this paper, we assumed a cooperation 
Hnk that may use both the message and the state information. Recent works assumed similar settings where the 
cooperation depends only on the state [(26l , as depicted in Fig.|9] or on the message only 1221 1231 as depicted in 
Fig. [TOl For the first case where the cooperation may use only the state information (Fig. |9]l, the capacity region 



mi ^ 




Encoder 1 





S- 



Encoder 



-'C12 



m2 



"Encoder! 




Fig. 9. State cooperation. An example inspired by the setting in 1261 . where the cooperation is a limited rate state information and is independent 
of the message. 



was derived in [261 and may be written as 

C12 = I{U;S) (81) 

Ri < I{Xi;Y\X2,S,U) (82) 

i?2 < I{X2;Y\Xi,S,U) (83) 

R1+R2 < I{Xi,X2;Y\S,U), (84) 

for some joint distribution of the form 

P(s, u)P(xi |s, u)Pix2\u)P{y\xi,X2,s). (85) 



21 




Fig. 10. Message cooperation. An example inspired by the setting in 1221 , where the cooperation is a function of the message only, and then 
after the cooperation stage the channel state is available to Encoder 1. 

For the second case where the cooperation may use only the message (Fig.fTOli the capacity region was considered 
in II22I . II23I and may be written as 

Ri < I{Xi;Y\X2,S,U) + Ci2 (86) 
R2 < I{X2;Y\Xi,S,U) (87) 

I{X,,X2;Y\S,U)+Ci2, 1 

> , (88) 
I{Xi,X2;Y\S) J 

for some joint distribution of the form 

P{s)P{u)P{xi\s,u)P{x2\u)P{y\xi,X2,s), (89) 

where U and V are auxiliary random variables with bounded cardinality. 

Both regions, the one in ([84li-(|85ll and the one in (|88]l-([89ll. are contained in the region of Theorem [T] where 
the cooperation may use both the message and the state. It is interesting to note that one can obtain the regions 
(|84]|-(|85]|. and d88Tl-(l89]l by adding only an additional constraint to the region of Theorem \T\ More precisely, to 
obtain the regions ([84li-(|85]l add the constraint C12 = I{U; S), and to obtain the region (|88]l-([89]l add the constraint 
/([/; 5) = to the region ©-dUl of Theorem □ 

Fig. [TT] depicts the capacity regions obtained for a cooperation link C12 = 0.5 for the three settings: 

1) state-cooperation, where the cooperation is based only on the state information (Fig. |9]l, 

2) message-cooperation, where the cooperation is based only on the message (Fig. [TO] i. 

3) message-state cooperation, where the cooperation may use both the state and the message (Fig. |6]l. 

In this example, one can note from Fig. [TT]that state-cooperation increases the capacity region only in the direction 
of R2, message-cooperation increases the capacity region only in the direction of and message-state cooperation 
increases the capacity region in the direction of both i?i and i?2. 



R1+R2 < 
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Fig. 11. The regions of three settings with a cooperation link C12 = 0.5. The blue region corresponds to the case where the cooperation is 
based only on the state information as depicted in Fig. |9] The green region corresponds to the case where the cooperation is based only on the 
message and not on the state as depicted in Fig. 1101 Finally, the red region is the one that corresponds to the setting of this paper where the 
cooperation may use both the state and the message as depicted in Fig. [6] 



From the comparison above, it is interesting to note that there are special cases where the state-only cooperation 
or the message-only cooperation performs as well as the combined state-message cooperation. 

Equal rates, i.e., Ri = R2: consider the example of one-way cooperation depicted in Fig. |6] where we are 
interested in equal-rates working-point, i.e., i?i = i?2- Since on the boundary region R2 < the best equal-rate 
working point is achieved by maximizing i?2- To maximize R2 in one-way cooperation, there is no need for message 
cooperation and therefore the state-only cooperation achieves the maximum equal rate point. 

Effectively, no power constraint, pi = P2 = 0.5: consider the one-way cooperation as depicted in Fig. |6] where, 
effectively, there is no power constraint; this means that pi,p2 may be equal to or larger than 0.5. For this case, 
the state information at the transmitter does not enlarge the rate region, hence the message-only cooperation as 
introduced by Willems 111 is optimal. 

A. Splitting the cooperation link in message-only and and state-only links 

In this subsection we investigate what happens if we split the cooperation link into two links: one link for 
message-only cooperation at rate and the other link for state-only cooperation at rate 0(2 as shown in Fig. [12] 
We derive the capacity region for this setting and show that the split is strictly suboptimal. 

Theorem 5: The capacity region of the MAC with separated links, for message and state cooperation, as shown 
in Fig. [12] is the closure of the set that contains all rates that satisfy 

C!2 > I(U;S) (90) 

Ri < I{Xi:Y\X2,S,U,V) + C'^'2 (91) 

R2 < IiX2;Y\Xi,S,U,V) (92) 

I(Xi,X2;Y\S,U,V) + Cr2, 
I{Xi,X2;Y\S,U) 
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Fig. 12. Separate message and state cooperation. There are two cooperation links at rates and (7^2 ■ The first link uses only the message 
information mi, the second link uses only the state information 5". 

for some joint distribution of the form 

P{s, u)P{v)P{xi\s, u, v)P{x2\u, v)P{y\xi,X2,s). (94) 

The proof of the theorem for the case where the MAC is of the general form P{y\xi, X2, s) is given in the 
appendix. The converse is based on the identification of the auxiUary random variable U being a function of the 
state sequence only, and the identification of the auxiliary random variable V being a function of the message AIi 
only; hence the pair ([/, S*") is independent of V, since Mi is independent of 5*". The achievability part is based 
on generating the coordination Ps,u and then multiplexing the cooperation MAC codebooks according to U. There 
is no need for binning in the achievability part where the coopertaion link is split. 




^(Ht(2pi) - Ht{p,)} i(ffi(2pi)-lfi(p,)) + 0.25 max/(Xi.X2;y|S) 

^1 

Fig. 13. Comparison between the capacity regions of separate state and message cooperation and joint state-message cooperation. The blue 
line corresponds to the capacity region of the setting in Fig. 1 131 where = = 0.25. The red line corresponds to the capacity region of 
the setting in Fig. 1101 where C12 = 0.5. 

Fig. [13] depicts the capacity region of the example where separate state cooperation and message cooperation 
exists (i.e., the setting of Fig. [TZt and Cfj = C12 = 0.25. From Fig. [13] we learn that using the naive strategy of 
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splitting the cooperation link into message-only cooperation and state-only cooperation is strictly suboptimal. 
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Appendix 

Here we present the proof of Theorem|5] where IVIAC is of the general form P(y|xi,a;2, s). 
Proof of Theorem \5][ 

Converse part: Assume that we have a (2"-^i , 2"-^^ , 2"^^ , 2'^^''^ , n) code. We will show the existence of a joint 
distribution P{s)P{u\s)P{v)P{xi\s,u,v)P{x2\u,v)P{y\xi,X2, s) that satisfies (|90]l-( ll04T ) within some e„, where 
e„ goes to zero as n ^ cxd. Let G {1, 2, 2"'^i2} and G {1, 2, 2"''-'"^} be the message sent on the 
state cooperation link and the message cooperation link, respectively. Consider 

> l{Ml2;S^) 

n 

j2m;Mi2,s'-') 

n 

Y,HS^■,U.,), (95) 

i=l 

where (a) follows from the fact that Si is i.i.d. and (b) follows from the definition of Ui, which is 

C/,^(Mf2,5*-i). (96) 



Now, consider 



nRi = H{Mi 

(a) 



H{M,,Mr,) 
= H{M^i) + H{A'h\Mr2) 
< nCJ^ + H{Mi\ Af ™ , M2 , ^" , Afi^2 ) 
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< nCJ'^ + I{Mi ; F" I Af™, Ah, 5", A/fj) + ncn 

n 



(rf) 

= w 



CT2 + ^(^1.*; ^2,«) + «e„, (97) 



where (a) follows from the fact that M"^ is a deterministic function of Mi, (b) from the fact that 5" is independent of 
Ml and A/fj is a deterministic function of 5", (c) from Fano's inequality and the definition of e„ = +i?2)^'i' 
Step (d) follows from the definition of the auxiliary random variable 

V^ ^ Mr2. (98) 
Now using similar steps as above we obtain the following additional upper bounds 

ni?2 = i^(A/2) 

= i/(M2|A//i,Af™,5",Ar^2) 

< /(Af2; r^lATi, M^^, 5", A/1'2) + "fin 

n 

< ^/(X2,,;y.|Xi,„\^„;7„S0 + ne„ 



and 



and 



(99) 



nRi+nR2 = M2, Af™) 

= i/(Mi,A/2,Af™|5") 

= H{Ml'^\S'') + i7(A/i, A/2|Af™, 5", M^^) 

< nC^^ + I {Ml , A/2 ; y " I A/™ , 5" , M^^ ) + ne„ 

n 

< nC^^+J2HXl,^,X2,^■,Y,\V„U„S,)+nen, (100) 

nRi+nR2 = H{Mi,M2,M^) 

= H{Mi,M2,Mr^\S^) 

< /(Afi,A/2;r"|5",Afi^2) + "en 

n 

< ^/(Xi,„X2,.;r,|i7„5,) + ne„ 

(101) 

Now, we note that Vi is independent of {Ui, Si) since A/i is independent of S", and X2 — {U, V) — (Xi, S'l) is a 
Markov chain since {M2,M{l,M(^) - (S"'"!, A/{5, Affj) - (A/i,S'") holds. Finally, let Q be a random variable 
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independent of (X",S'",F"), and uniformly distributed over the set {1, 2, 3, .., n}. Define the random variables 
U = (Q, Uq), V = {Q, Vq), and we obtain that the region given by (|90b-(l94li is an outer bound to the achievable 
region. 

To show that the cardinality of the random variables U and V is bounded we follow similar steps as in Lemma 
12] first for U and then for V. We note that the cardinality of auxiliary random variables U may be bounded by 
\U\ < |>S| + 4 and for auxiliary random variables V, we have |V| < min(|A'i||A'2||<S||W| + 3, |3^||iS||Z^| + 4). 

Outline of achievability part: The achievability part is straightforward once we observe that we can generate 
a coordination Pu s with a rate Cf2 > I{U; S) and then use a multiplexer where [/", which is known to all 
encoders and to the decoder, is the control sequence of the multiplexer For a given U = u we obtain a MAC with 
cooperation C{2 where the state is known to one encoder and to the decoder, hence the region 



< 



I{Xi;Y\X2,S,U = u,V) + C: 



12 



(102) 



i?2 



< 



(103) 




(104) 



